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Scientific  Progress 

Decentralized  estimation  and  control  algorithms  for  design  of  reliable  guidance,  navigation  and  control  systems  for  autonomous 
vehicles  with  the  use  of  sensor  networks  that  can  enable  more  precise  navigation  laws,  lower  cost  or  smaller  future  systems, 
and  increased  reliability,  are  the  objectives  of  this  research.  The  technical  focus  is  the  integration  of  estimation  and  control 
algorithms  for  multiple  vehicles  that  would  lead  to  guaranteed  performance  bounds  in  uncertain,  and  possibly  occluded, 
environments  in  the  presence  of  communication  losses  and  network  failures. 


During  the  contract  period  we  explored  design  of  distributed  cooperative  control  laws  for  multi-agent  systems  that  take  the 
uncertainties  in  the  agent  dynamics  into  consideration. 

1.  We  proposed  a  cascaded  control  structure  for  multi-agent  coordination  in  the  presence  of  uncertain  agent  dynamics  and 
disturbances,  which  resolved  the  coupling  between  the  communication  topology  and  the  system  dynamics.  We  implemented 
and  tested  the  proposed  algorithms  on  the  UIUC  multi-robot  testbed. 

2.  We  extended  the  cascaded  control  structure  for  state-dependent  (relative-position-induced)  network  topology  to  enable  a 
decoupled  design  for  distributed  control  with  event-triggered  sampling.  The  decoupled  architecture  helps  to  leverage  tools  from 
network  theory  and  robust  control  to  enable  the  operation  of  the  large-scale  system  with  guaranteed  performance  bounds  and 
robustness  margins. 

3.  We  developed  a  PI  consensus  algorithm  for  a  multi-agent  system  with  disturbances  in  each  agent's  dynamics  operating  over 
time-varying  communication  topologies  and  with  quantized  feedback. 

4.  We  designed  time-coordinated  3D  path-following  algorithms  for  multiple  quadrotors  and  flight-tested  the  algorithms  at  the 
Naval  Postgraduate  School. 

5.  LI  adaptive  controller  is  the  core  technology  that  enables  distributed  control  design  for  multi-agent  systems  with  uncertainties 
and  guaranteed  performance.  We  have  made  several  modifications  to  the  standard  LI  adaptive  controller  algorithm  to  relax  the 
CPU  requirements,  making  it  more  suitable  for  systems  with  limited  computation  and  sensing  capabilities. 

6.  Throughout  our  research,  we  have  been  considering  coordination  under  a  very  realistic  communication  setup,  i.e.,  we  have 
assumed  distance-based  network  or  network  with  a  integral  type  of  connectivity  (which  is  a  much  weaker  assumption  than  the 
point-wise  connectivity),  and  shown  the  robustness  of  our  coordination  algorithms.  We  start  to  consider  stochastic  network 
which  is  in  nature  closer  to  the  physical  communication  link  used  in  practice. 
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Robust  Architectures  for  Multi-Agent  Systems 
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Brief  Literature  Overview 

Decoupled  Design  for  Distributed  Control  of  Uncertain 
Networked  Control  Systems 


Cooperative  Missions  of  UAVs 


Objectives  of  Distributed  Multi-Agent  Systems 


Distributed  Stabilization 


■  Weak  physical  coupling 
Decentralized  control  -  Siljak  1991 

■Strong  physical  coupling 

Distributed  control  -  Bamieh  2002  TAC,  D'Andrea 
2003  TAC,  Dunbar  2007  TAC,  Rice  2009  TAC 

Cooperative  Control 

■  Consensus  -  Olfati-Saber  2005CDC,  Ren  2007CS 

■  Flocking  —  Olfati-Saber  2006TAC,  Tanner  2003CDC, 
Blondel  2005CDC 

■  Formation  -  Tabuada  2001ACC,  Tanner  2002IFAC, 
Egerstedt  2001TRA 

■  Maximal  coverage  -  Buiio  2005CC,  Cortes 
2004TRA,  Martinez  2007CSM 

■  Optimization  -  Rabbat  2004  IPSN,  Palomar 
2007TAC,  Lee  2004CL 


Motion  Induced  Communication 


Flocking: 

■  Increase  the  chance  of  detecting  enemies 
or  targets 

Self-assembled  network  (Olfati-Saber  2006) 

■  No  assumptions  on  network  topology  (but 
objective  for  the  group),  more  realistic  for  low  cost  agents  with 
limited  communication  range 

■  Ideal  double  integrator  dynamics 

■  Uncertain  dynamics  (Li  ACC  2011) 

Nonholonomic  agents  (more  realistic  and  challenging) 

■  Tanner  2004  :  inter-agent  velocity  alignment,  assumptions 
on  network  topology 


needs  a  common 


Main  Contributions 


Multiple  nonholonomic  agents 
■S  Uncertain  dynamics  and  disturbances 

Common  goal:  target  tracking 
Self-assembled  flocking  and  collision  avoidance 
Cascaded  control  structure 

S  Coordination  and  uncertainties  decoupled  and  addressed 
independently 

S  Guaranteed  performance  bounds 


Problem  Formulation 


N  Mobile  (heterogeneous)  agents 

cos(0*(i)) 
sin(0*  (t)) 

9\t)  =  w*(t) 

»*(*)  -  Gl(s)(ul,(s)  +  zl(s )) 

"*(«)  =  Gl(s){ul(s)  +  zl(s)) 

Target:  constant  velocity,  qt,  9t>vt  are  known  to  agents 
Communication:  inter-agent  communication  range  r 


Objective:  track  the  target  forming  a  flock  and  avoid  collision 


Preliminaries  from  graph  theory 


General  definition 


Graph  induced  by  agents'  positions 


Cascaded  Control  Structure  ::  Overview 


"Simulator"  (coordination)  +  Local  Tracking  Law  (uncertainties) 


■  Simulator:  virtual  ideal  kinematic  model 

>  Running  in  each  agent's  computer 

>  Driven  by  a  cooperative  guidance  law  that  achieves  flocking  and 
collision  avoidance 

>  Each  agent  exchanges  information  of  its  simulator  with  neighbors; 
this  information  is  uncertainty-free,  and  is  used  in  the  guidance  law 

>  Position  and  velocity  of  the  simulator  serve  as  reference  inputs  for 
the  real  agent  to  track 


Local  tracking  controller :  track  the  simulator 

>  Outer-loop  :  guidance  law  for  the  kinematic  model 

>  Inner-loop:  adaptive  controller  for  uncertain  dynamics 


Cascaded  Control  Structure  ::  Overview 


A  demo  of  the  simulator-follower  structure 


Cascaded  Control  Structure  ::  Overview 


Controller 


Simulator :  Flocking  Algorithm  for  Ideal  Kinematic  Model 


Ideal  kinematic  model 


Ql 


/jr*Z 


V 


cos  01 
sin#* 


=  uj. 


4(0)  =  a<(0) ,  4(0)  =  4(0) ,  4(0)  =  *(0) 


Flocking  algorithm 


Smooth  transition  from 
aggregation  to  heading 
alignment 


v\  =  v t  -  kvVqiVl(qs)  -  [cos 0*  sin 0*] 

w*  =  -M^-^d) 


o\ 


=  angle(-Vq*  V\q&)  +  vt) 


ilT 


Collective  potential  function 

v*(*)=  E  @CII«£- -411)  40(114  -*11) 


jeJVr(g) 


Potential  Functions 


Va(z) 
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Track  the  Simulator :  Outer-loop 


■  Objective  :  the  real  agent  tracks  the  simulator,  i.e.,  \pe 


■  Tracking  error 


xe 

cos  0  sin  9  0 

i— 

1 

Cft 

H 

i _ 

Pe  = 

Ve 

— 

sin  9  cos  9  0 

ys-y 

.  °e  _ 

0  0  1 

_  6S  -  6  _ 
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Xe 

Goye  —  v  +  vs  cos  9e 

Pe  = 

Vc 

— 

—l oxe  +  vs  sin  9e 

_  . 

LOs—  GO 

det(T)  f  0. 


■  Velocity  commands  (Kanayama  et  al,  1991) 


^ c 


Vc  I  _  fcx&e  H"~  V8  COS  9e 

ojc  \  ~  [  ws  +  kyye  +  ke  sin  9e 


Track  the  Simulator :  Outer-loop 


■  For  perfect  velocity  tracking:  v  =  vc,co  —  coc 


Pe  =  f{Pe  ,  Us)  = 


(ws  +  kyye  +  kg  sin  9e)ye  -  kxxe 
- (ws  +  kyye  +  kg  sin  0e)xe  +  vs  sin  9e 

-kyVe  -  ko  sin  0e 


>  vs,  a)s  constant:  asymptotic  stability 


Key  result:  imperfect  velocity  tracking: 

>  If  \v  -  vc\<  Yv,  l<w  -  <wc|  <  Ya >  >  then  |pe|  <  Ye>  where 


Track  the  Simulator :  Inner-loop 


Objective:  v(s)  Mv(s)vc,  o)(s)  «  Mw(s)o)c(s) 

v’(«)  =  Gt(s)«(s)  +  4(®)) 

ul{s)  =  Gl(s){ul{s)  +  40)) 

Solution:  LI  Adaptive  Controller 
Main  features  of  LI  Adaptive  Controller 

>  Guaranteed  transient  response  for  system's  both  input  and  output: 


Track  the  Simulator :  Inner-loop 


LI  adaptive  controller  for  v,  Mv(s )  = 

>  Output  predictor:  £(t)  =  —mvv{t)  +  mv(uv(t)  +  av(t)) 

>  Adaptive  law:  ^(()  =  r„Proj(^(t),-®{t)) 

>  Control  law:  ,  ,  _  „  , , , 

—  'Svy*/ \vc\£J  &v\y)) 


Hv(s)  =  - - AM*) 

\\Hv(s)(l  -  Cv(s))\\ClLv  <  l 


^  LI  stability  condition:  "** v c»(*)G»(s)+(i-c„(*))jif„(«) 


stable 


Key  result:  If  vc  is  bounded  and  vc  <  y*  ,  then 


v  —  V, 


ref 

-  7v  ,  des  , 

£00  <  — s=  +  7V  + 


m 


V 


Short  Summary 


■  \v  —  vc\,  |o>  —  a)c|  small  =>  \pe  \  bounded  Vt 

■  LI  adaptive  controller:  \v  —  vc\Leo,  |<u  —  coch^  small 

Agent  can  track  the  simulator  with  transient  performance  guarantees! 


Coupling  between  dynamics  and  topology 


Coupling  exists  because: 

■  Communication  is  induced  by  motion,  no  artificial  assumptions 

■  Input  to  the  simulator  is  based  on  Qr(q),  not  Qr(qs ) 


>  Without  transient  guarantees,  it  is 
possible  that  simulators  "move"  to  the 
same  position 


>  With  transient  guarantees,  we  can  select 


(i,j)  €  £r(ys)  =s>  (i,j)  e  £r(q) 


Real  agents  can’t  talk, 
simulators  “collide”,  and 
generate  infinite  vs,a>s 


The  guaranteed  transie 
the  controller  is  the  k 
coupling  issue. 


Real  agents  are  always 
close  to  simulator,  and 
well  behaving 


Simulation:  3  agents,  without  LI  adaptive  controller 


■  Algorithm  designed  for  ideal  dynamics 


Response  for  ideal  dynamics 


Gi(s)  =  GUs)  = -,  4  =  4  =  o 

s 


Response  for  slow  dynamics 

Gi(s)  =  Gl(s)  =  =  4  =  0 


Simulation:  3  agents,  with  LI  adaptive  controller 


■  Trajectories 


Simulation:  3  agents,  with  LI  adaptive  controller 


■  Velocity  tracking 


v 


t 

l 
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Simulation:  3  agents,  with  LI  adaptive  controller 


Animation 


Simulation:  20  agents,  with  LI  adaptive  controller 


Animation 


Experimental  results 


■  Ground  robots 


Experimental  results 


■  Experimental  configuration 


Camera  1 


Image 


Agent  1 


Information  of  all  robots 


Agent  N 


Fusion  Center 


Target 


Camera  4 


Image 


Wireless  Network 


Experimental  results 


■  A  test  run  with  2  followers 


Coordinated  Road  Search  and  Target  Tracking -The  Concept 


Thermal  seeking 
sggrmg  gliders  is 

used_  as  a 
Flying  Antenng 

to  extend_ 
communication 


range 


Remote 


SjQarina 


Target  j 


Single  DOF 
gimbal  with  high 
resolution  cgmerg 

delivers  satellite 
quality  imagery  well 
suited  for  tgrget  ID 


2DoF  P/T  gimbal 
with  a  video 
cgmerg  enables 
vision  based  UAV 
guidance  and  tgrget 
trgcking 


Road  of 


interest 


Flightiest:  Coordinated  Road  Capture  and  Search 


Coordination  in  "Road  Search"  mode  (CPF)  is  represented  by  the  results  of  stitching  4  consecutive 


high  resolution  frames  taken  from  the  UAV  above: 

-  UAVs  are  looking  at  the  same  virtual  target  on  the  road 
-  Successful  coordination  results  in  "encapsulating"  second  UAV  in  each  frame 


Flight  imagery  of  4  consecutive 
frames  with  coordinating  UAV  below 


UAV2  path 


Flightiest:  Coordinated  Road  Capture  and  Search 


Trajectories 


Coordinated  Road  Capture 

•  two  UAVs  generate  real-time 
capture  paths 

•  coordination  is  used  to  robustly 
achieve  simultaneous  arrival 

Road  capture 


Coordinated  Road  Search 

•  two  UAVs  follow  the  road  search 
paths 

•  coordination  is  used  to  guarantee 
nonzero  intersection  of  the  FOVs 
between  two  cameras 


East,  m 


CPF  coordination  states 
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Flightiest:  Coordinated  Road  Capture  and  Search 


If  coordination  is  successful  then  both  cameras 
look  at  the  same  place 

The  video  at  the  top  is  from  the  UAV  with  a 
standard  2DOF  gimbaled  camera 

The  video  at  the  bottom  was  generated  by  the 
high  rez  camera  stabilized  by  a  1DOF  gimbal 
(this  was  accounted  for  in  the  path  generation) 


3  &  Internet  *  100% 

ranrasr- — —  ■  mm 


Snapshot 


Flight  Test:  Coordinated  Target  Tracking 


Once  the  target  is  designated  by  the  user 

•  two  UAVs  switch  from  road  search  to 
coordinated  target  tracking  mode 


•  the  pre-assigned  phase  separation  is 
pi/2,  maintained  by  coordination 


Trajectories 


CTTR  phase  separation/coordination  errors 


Conclusions  for  Coordinated  Road  Search 


Coordinated  Control  of  Multiple  UAVs: 
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Real-Time  Issues 


Limited  Communication  Resource 

>  Transmission  delays,  discrete  data  transmission,  packet  loss,  quantization 


■Sampled-Data  Systems  (Single  Plant) 

Periodically  sampled  system  —  chen  1995 

Event-triggered  Control  —  Arzen  1999IFAC,  Tabuada  2007TAC 

•  Saves  Communication  Resource,  but  requires  hardware  detector 

Self-triggered  control  —  Velasco  2002RTSS,  Wang  2009TAC  2010TAC,  Anta  2010TAC 

•  Predict  the  next  execution  time  based  on  the  past  information.  No  need  for  hardware! 

■Real-Time  Communication  in  Multi-Agent  Systems 

Physically  Decoupled 

•  Consensus,  Dimarogonas  2009CDC,  2011IFAC,  Yu2011CDC 

•  Maximum  Coverage,  Nowzari,  2011Automatica 

Physically  Coupled 

•  Stabilization,  Wang  2009TAC  2011TAC 

•  Network  Utility  Maximization,  Wan  2009IPSN 


2012ACC 

>  Perfect  Model 

•  No  Physical  Uncertainty 


Robust  Control  and  Communication  Co-Design 


■  lnput-to-state  stability  for  robustness 

□  Periodic  Transmission  -  Nesic  2004TAC 

□  Event-triggering  broadcast  -  Wang2008ACC,  Mazo  2009CDC 

□  ISS  only  provides  an  upper  bound  on  the  state  trajectory,  without 
quantifying  the  transient  performance. 

■  Li-adaptation-based  event-triggering  for  performance 

□  State  Feedback,  linear  interconnection,  matched  uncertainty,  fixed 
communication  model  -  (presented  in  AFOSR  in  2010) 

Drawback:  Event-triggering  was  defined  to  transmit  the  real  system  outputs 
over  the  network,  often  measured  by  noisy  sensors. 

Desired  Solution: 

1.  Network  must  be  used  for  communication  of  information,  NOT  affectecj  by 
system  uncertainties  or  noise. 

2. The  design  of  control  and  communication  can  be  decoupled  to  the  maximum 
extent  so  that  the  existing  techniques  can  be  easily  leveraged. 


Problem  Formulation 


Ideal  Model: 

xf  =  A?*? +  &{*,#,& 

?4d  =  Cixf,  x‘d(0)  =  x® 

Ideal  Controller: 


9i 

hi 


Real  Subsystem: 


■  Subsystems  are  physically  coupled 

Unmatched  uncertainties  in  the 
system  dynamics  and 
interconnections 

Uncertainties  are  Locally  Lipschitz 

Output  feedback 

Nonlinear  ideal  interconnection 

■  Limited  Communication 

Discrete  data  transmission 
Delay  and  packet  loss  may  exist 


Decoupled  Control  Architecture 


To  what  level  can  we  decouple  the  design  of  control  and 
communication? 

Solution: 


Control  Design 


Robust  adaptive 
control 

Real  Dynamics  with 
Robust  Adaptive 
Controller 

Reference  Model 

Ideal  Model 

■  Regard  the  real  subsystem  as  a  single  system,  with  the  signals  from  its 
reference  model  as  the  reference  signals; 

■  Robust  adaptive  control  ensures  the  closeness  between  signals  inside  the 
real  dynamics  and  the  reference  model  inside  each  individual  agent. 


Communication  Design 


Real  Dynamics  with 
Robust  Adaptive 
Controller 

Reference  Model 

Comm,  design 

Ideal  Model 

■  Regard  the  real  subsystem  as  a  single  system,  with  the  signals  from  its 
reference  model  as  the  reference  signals; 

■  Robust  adaptive  control  ensures  the  closeness  between  signals  inside  the 
real  dynamics  and  the  reference  model  inside  each  individual  agent. 


■  No  physical  uncertainties  are  involved  in  the  communication  model  design; 

■  If  the  signals  over  the  network  are  bounded,  the  closeness  between  the 
real  dynamics  and  the  reference  model  will  NOT  be  affected  by 

>  The  type  of  communication  models 

>  The  network  effects,  such  as  delays,  packet  loss,  etc. 


Design  Procedure 


Given  a  multi-agent  system 

1. Model  the  system  dynamics  and  obtain  the  ideal  model 

2. Design  the  ideal  control  algorithm  based  on  the  ideal  model 

3. Design  the  communication  model  based  on  the  ideal  model  so 
that 

□  The  resulting  closed-loop  system  (reference  model)  fulfills  the  same 
objective  that  the  ideal  model  does 

□  The  input  and  the  output  of  the  resulting  reference  system  are 
bounded. 

4. With  the  bounds  obtained  in  Step  3,  design  the  distributed  local 
robust  adaptive  controller 

The  only  coupling  between  the  control  and  the  communication 
design  is  that  the  bounds  on  the  input  and  the  output  of  the 
reference  model  will  be  used  in  selecting  the  parameters  of  the 
control  generator. 


The  Difference  between  Reference  and  Ideal  Models 


The  reference  model: 


*4 


AT^  +  BiU*  +  U) 

Qxl 

hi  (t,  ■ 


The  combined  closed-loop  reference  model: 


ibs  =  $  (t1wa(t),fia(t)) 


The  closed-loop  ideal  model: 

wld  =  $  (t1  wld(t),yld(t)) 

The  closed-loop  reference  model  can  be  written  as: 


«;s  =  *  (t  ws(t),  ys{t))  +  ( t ,  ws(t),  yB(t))  -  $  ( t ,  ws(t),  ys{t )) 


Ideal  Model 


Pertubation 


The  key  challenge  in  the  communication  model  design  is  to  ensure  that  the 
difference  between  if  and  if  is  not  TOO  large. 


Performance  Bound 


Assume  that 

•  $'(£.  ios,  y®)  and  its  first  partial  derivatives  are  continuous,  bounded,  and 
Lipschitz  in  uf ,  uniformly  in  L  for  all  t  >  0  and  wld  in  a  compact  set; 

•  (£,  w;s,  y8)  is  piecewise  continuous  in  t,  locally  Lipschitz  in  if,  ys; 

•  there  exist  continuous,  positive  definite  class  K  functions  cvi,  ct 2,  03  and 
a  continuously  differentiable  function  V  such  that 

a=i(l|w,d||)  <  ^(*,te/id)  <  a2(||w,d||) 

fiV  f)V 

~dt+d^r''s -  _a:i(ll'M’'d|l); 

•  u?ld  =  0  is  an  exponentially  stable  equilibrium  point  of  the  ideal  model. 
Then  there  exist  ,8,  q  >  0,  such  that  if 


Communication  Constraints 

we  have 


Y1 11^  _  £1a»  ^  7>, 


\w 


id 


Enforcing  Communication  Constraint 


Assume  that 


Example  (to  enforce  the  communication  constraint): 

Event  Triggered  Data  Transmission: 

pre-specified  threshold 

Transmit  when  the  local  measurement  error 

IlstfW  —  y?(*)ll  exceeds  a  pre-specified  positive 
constant. 

local  error  /  \ 

The  sampled  output  of  the  reference  model  is 

transmitted.  The  real  output  is  not  involved.  transmitting  instant 

- W 

=  0  is  an  exponentially  stable  equilibrium  point  of  the  ideal  model. 


Then  there  exist  ,3,  ?}  >  0,  such  that  if 


11/  -  /IIa»  <  v, 


Communication  Constraints 


<  fab 


we  have 


Local  Networked  LI  Adaptive  Control  Generator 


This  Li  adaptive  control  architecture  uses  data  from  the  reference  model  that 
carries  the  information  from  the  network. 


Main  Results 


Assume  that  the  input  and  the  output  of  the  ith  reference  model  are  bounded 

s 

by  pf  and  p-  ,  respectively.  If  ^py  such  that 


Py  >  &(||a£ II )  4-  ipi(pUi)  +  7i  (  max p\ 


+  11  (/  -  *i«)  ifliPy  +  bi)  + 


1 


OiWnnJA?  +  TiCi)) 
for  any  i,  then  ||i/(£)||  and  ||t<(£)||  are  uniformly  bounded  and 


y  -  »slk.  <  pk,  ||(/  -  F<(*))ffi(«)||jCl  + 


where  <fo,  7^  a,;,  $  are  class  /Coo  functions  and  ermin(*)  denotes  the  minimal 
singular  value  of  a  matrix. 


■  We  can  always  find  py  such  that  the  stability  condition  holds. 

■  The  performance  bound  can  be  rendered  arbitrarily  small  by 
increasing  the  bandwidth  of  the  low-pass  filter. 

■  Large  bandwidth  leads  to  small  stability  margin,  which  suggests 
tradeoff  between  performance  and  robustness. 


Real-Time  l±  Adaptive  Control  Generator 


When  implementing  the  controller  in  digital  processors,  we  seek  real-time  LI 
adaptive  controller  and  consider  the  problem  of  computational  resource 
management. 

Assume  that  the  C\  stability  condition  holds.  For  each  agent,  if  the  time 
intervals  between  two  consecutive  receptions  of  the  data  from  the  network  are 
lower  bounded  by  a  positive  constant,  then  there  exists  a  continuous  function 
ctj,  satisfying  (0,0, 0,0, 0)  =  0  and  a  positive  constant  7*  such  that  if 

f  Comp.  Period;  Sensing  Period;  Actuation  Period; 

*  \  Sensing  Delay;  Actuation  Delay 

Sensing  Period  >  Sensing  Delay 
Actuation  Period  >  Actuation  Delay 


hold,  then  ||y,-  -  y- 1|£„  <  7 £. 


■  The  performance  is  subject  to  the  hardware  limitations. 


New  Results  on  Cooperative  Missions 


Time-critical  applications  for  multiple  vehicles  with  spatial  constraints: 

•  Sequential  auto-landing  (UAVs) 

•  Coordinated  reconnaissance  missions 

•  Simultaneous  arrival  at  multiple  locations 


Courtesy:  NPS  Courtesy:  LARSyS,  1ST 


\ 

Coordinate  on  the  arrival  of  a  leader  (or  group  of  leaders)  subject  to 
collision-avoidance,  communications,  and  spatial  constraints 
_ _ _ / 


Overall  Conceptual  Architecture:  Decoupling  Space  and  Time 


Guidance  Outer-Loop  kinematic  feedback 


Xargay,  Dobrokhodoy \  Kaminer,  Pascool,  Hovakimyan,  &  Coo  2012 


Time-Critical  Coordination  ::  New  Results  and  Extensions 


- \ 

Consensus  problem:  reach  an  agreement  on  some  distributed 
variables  of  interest  (coordination  states)  as  well  as  their  rates 

_ _ _ _ _ / 


Xi(t)  —  Xj(t)  o, 

V  i,j  e  In 

Synchronize  in  both 

> 

•  f  t  \  ^ — KOG 

Xi{t)  — ►  p, 

V  i  e  In 

'position'  and  'speed' 

Reference  rate 

■  New  results: 

•  New  coordination  states  that  accommodate  time-varying  desired  speed  profiles; 

•  Performance  guarantees  in  the  presence  of  temporary  link  losses  and  disconnected  graphs: 

>  Lower  bound  on  the  (exponential)  convergence  rate... 

>  ...  as  a  function  of  the  QoS  of  the  network  and  the  number  of  leaders; 

•  In  the  presence  of  quantization,  existence  of  equilibrium  points  corresponding  to  undesirable 
steady  solutions  with  zero  'speed': 

>  Derivation  of  a  bound  on  the  quantizer  step  size  to  ensure  that  these  equilibria  do  not  exist; 

•  Performance  improvement  under  low  connectivity  through  'onboard  estimators'; 

•  Performance  improvement  via  emergent  leaders. 


Key  Ideas  &  Previous  Work 


PI  protocol: 


Critical  to  coordinate  'speedy 

Allows  agents  to  learn  a  reference  rate  command  and  reject  constant  disturbances. 


•  Kaminer,  Yakimenko,  Pascoal,  &  Ghabcheloo  2006 

•  Carli,  Chiuso,  Schenato,  &  Zampieri  2008 

•  Bai,  Arcak,  &  Wen  2008  (generalized  PI  protocol) 


9  Fixed  connected  graphs; 

No  guaranteed  convergence  rate 


Virtual  leaders: 


Allows  to  track  a  constant  reference  rate  command  with  zero  steady^state  error , 


Drawback :  adding  agents  reduces  the  connectivity  level. 


•  Shi,  Wang,  <&  Chu  2006 

•  Ren  &  Beard  2007 

•  Su,  Wang,  &  Lin  2009 


9  The  'virtual  leader'  is  implemented 
as  an  isqlatecj  node 
providing  a  reference  trajectory 


'Extra  agent'  imposes  a  reference 
rate  and  its  dynamics  are  affected.  by 
othei  agents 


I 


uantized  consensus: 


Quantization  can  create  equilibrium  points  corresponding  to  undesjrable  steady, 
solutjons  wjtli  zero  'speech. 


•  Kashyap,  Basar,  &  Srikant  2007 

•  Censi  <S  Murray  2009 

•  Nedic,  Olshevsky,  Ozdaglar ;  &  Tsitsiklis  2009 

•  Ceragioli,  De  Persis,  <S  Frasca  2011 


In  the  'conventional'  agreement 
problem,  quantization  leads  to 
'practjcaj  consensus' 


Guaranteed,  rate  of  convergencei 


Critical  to  ensure  successful  execution  ofthe  mission- 


Olfati  Saber  <S  Murray  2003 

Kashyap,  Basar,  <S  Srikant  2007 

Nedic,  Olshevsky,  Ozdaglar,  &  Tsitsiklis  2009 


Convergence  rates  derived  only  for 
'conventional'  consensus  problems 


Coordination  States  ::  Time-Varying  Speed  Profiles 


■  For  constant  desired  speed  profiles: 

S  Normalized  curvilinear  abscissas : 

:  [0»  td]  [0,  l] 


SPACE 

P  =  Vd,i/tfi 


■  For  time-varying  desired  speed  profiles: 
S  Time  variables: 

,fH  •  [0?  II  —>■  [0?  £2] 


m = *m) 


TIME 

P=  1 
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m 

Q 

Ut) 

i 

i 

i 

*$(*) 

\ 

. /m 

/  Coordination  error 

0 

/  1 

r _ : _ ■ _ ^ 

$(<) 

■  Normalized  abscissas:  (<)—■£}(£) 


Desired 

relative  positions 


■  New  time  variables:  &(4)  -  ^(t) 


Desired 

relative  positions 


♦>  In  the  case  of  spatially.  deconflicted.  /paths,  there  is  no  risk  of 
collision;  however ;  mission-specific  goals  will  not  be  satisfied. 


Agent  Dynamics  &  Communications  Network 


Consider  a  network  of  n  integrator-agents: 

x  i(t)  =  Ui(t) +dit  Xi(0)  =  Xio,  i€ln:={ 

with  dynamic  information  flow  Qo(t)  (Vo,fo(t)). 


Communications  network: 


■Each  agent  can  only  exchange  information  with  a  set  of  neighboring  agents; 

■Communications  between  agents  are  bidirectional  and  information  is  transmitted 

continuously  with  no  delays; 

■Connectivity  of  the  communications  network  at  time  satisfies: 


— 

t+T 

\ 

1  1  /* 

nT  J  >  Vt>0 

V. 

t 

- > 

Arcak  2007 


•  Parameters  T  and  (j,  characterize  the  QoS  of  the  network; 

•  Graph  connected  in  an  integral  sense,  not  piecewise  in  time: 

S  The  graph  may  be  disconnected  during  some  interval  of  time... 

S  ...  or  may  even  fail  to  be  connected  at  all  times. 


Virtual  Agents  &  Extended  Network 


■  We  add  n £  virtual  agents  with  dynamics: 

xu{t)  =  u«(t),  XH(0)  =  xm, 

♦>  To  limit  the  amount  of  information  transmitted  over  the  network,  both  leaders 
and  followers  only  exchange  one  coordination  state  with  their  neighbors. 

S  Followers  exchange  their  own  actual  states. 

S  Leaders  only  exchange  the  state  of  their  virtual  agents. 


Disturbance-free  dynamics 

i  €  Xt  ■—  {1 


r  S 

Having  multiple  leaders  improves  robustness  to 
single-point  failures 

_ / 


Xargay,  Choe,  Hovakimyan,  &  Kaminer  2012 


PI  Protocol  &  Collective  Dynamics 


Distributed  protocol:  uu  =  kp  (xj  ~  xa)  +  A  *  G  Tf 

u,,  -  kP  J^jeK  (xi  ~xi)  +  Xi,  ieXn 

Xi  =  kj  J2je AT,  (XJ  ~  xi)  >  Xi(0)  =  Xio,  i  €  2 „ 

•  Reference  rate  only  available  to  the  leaders; 

•  Proportional-integral  control  structure: 

S  Disturbance  rejection  capabilities; 

S  Followers  can  learn  the  reference  rate  command; 

•  Each  vehicle  exchanges  only  its  coordination  state  xm(t)  with  its  neighbors. 


Closed-loop  collective  dynamics: 


f 

Switched  LTI  system 


x(t)  = 


—kpL(t)x(t)  + 


x(*)+dJ 


-fciCT L(t)x(t) , 


x(Q)  —  x0 
x(0)  =  Xo 


\ 


/ 


Convergence  Properties 


■  Define  the  consensus  error  state  £(i)  :=  [Cl(*)T!  C2(£)T]T; 

Ci(f)  :=  Qnx{t )  _  x(t)  e  span{liv} 

C2 (t)  :=  x(t)  ~  pin  +  d  Uj_  x(t)  =  plN 


■  Closed-loop  collective  dynamics: 

C(t)  =  Ac(t)C(t) , 


C(0)  =  Co 


f  > 

Switched  LTI  system 

s.  > 


■  There  exist  coordination  control  gains  such  that 

IIC(i)ll<«cllC(0)||  e"*-* 


f  > 

Proof  is  constructive 


where  Ac  >  :=  (1  +  A)"1 ,  A  >  2* 

■  Moreover,  the  coordination  states  and  their  rates  of  change  satisfy: 

lim^oo  |  Xi  {t )  -  Xj  (t )  |  =  0 ,  i ,  j  e  ln 

limt->OG  *^*(^)  p  7  ^  ^  2^1 


Convergence  under  Quantization 


PI  protocol  under  quantized  feedback: 


t  > 

Only  information  exchanged  over 
the  network  is  quantized 


u  =  -kP  (f>(t)x  —  A(t)  q(x)^  +  [pl£*  ] 

X  =  ~kjCT  (£>{t)x  -  A(t)  q(x)^  ,  x(0)  =  Xo 


•  Caratheodory  solutions  might  not  exist;  need  to  consider  solutions  in  the 
sense  of  Krasovsky.  ( Ceragiolo ,  De  Persis,  &  Frasca  2011) 


•  Potential  existence  of  undesirable  attractors/equilibria  if: 

A  >  2ne  M 
—  n(n  —  1)  kp 


Uniform  ultimate  boundedness  with  ultimate  bounds  proportional  to  the  step 
size  of  the  (uniform)  quantizers: 

\xi(t)  -  Xj(t)\  <c*iA 
|±i(t)  -  p\  <a2A  ’ 


